timekit: New Documentation, Function Improvements, Forecasting Vignette
Written by Matt Dancho on May 17, 2017
We’ve just released
timekit v0.3.0 to CRAN. The package updates include changes that help with making an accurate future time series with
tk_make_future_timeseries() and we’ve added a few features to
tk_get_timeseries_signature(). Most important are the new vignettes that cover both the making of future time series task and forecasting using the
timekit package. If you saw our last timekit post, you were probably surprised to learn that you can use machine learning to forecast using the time series signature as an engineered feature space. Now we are expanding on that concept by providing two new vignettes that teach you how to use ML and data mining for time series predictions. We’re really excited about the prospects of ML applications with time series. If you are too, I strongly encourage you to explore the
timekit package important links below. Don’t forget to check out our announcements and to follow us on social media to stay up on the latest Business Science news, events and information! Here’s a summary of the updates.
We’ve got some great new documentation to really help speed up usage of
timekit particularly with respect to applications in forecasting. The doc’s are a big part of the update so we’ll start there first. The package changes have to do with the
tk_get_timeseries_signature() functions. Let’s explore.
New Forecasting Vignette
The vignette Forecasting Using the Time Series Signature with timekit is a new resource for anyone interested in using data mining and machine learning to predict (forecast) future time-based observations. The idea is simple: there’s a lot of information within a time stamp that can be expanded into what is called the time series signature. Patterns between the target and the signature can be modeled or learned. The vignette uses the Bike Sharing Dataset available at the UCI Machine Learning Repository and made popular by Kaggle Competitions. We walk the reader through the forecasting process using the time series signature from start to finish covering all major tasks including:
- Creating training and test sets
- Modeling with the time series signature
- Validating the model using the test set and inspecting the test set accuracy
- Forecasting using the model and accounting for prediction intervals
The reader learns how to start with a dataset and end with the forecast shown below!
New Future Time Series Vignette
Making a future time series can be difficult, especially when dealing with daily data that can have missing weekends, holidays, or periods of the year that activity is slower (or non-existent). Further, when forecasting using a time series signature it’s important to get the future time series sequence correct. Fortunately, we’ve put a lot of thought into creating a useful and user friendly function,
tk_make_future_timeseries(), to help with this task.
We thought future timeseries accuracy was so important that we gave it a vignette. In the vignette you’ll learn how to inspect a time series to identify patterns in the time series frequency. We show you how to plot the frequency and what to look for. Then, we show you how to use the various arguments to
tk_make_future_timeseries() to input the existing index and output a future index that matches your expectations. We focus on the two main arguments that adjust the internal time-series-picking algorithm:
inspect_months (new!). We address the pros and cons to each argument by exposing the user to Type I and Type II errors. Then we show how to counteract these errors with
insert_values (new!). The vignette walks you through the entire process showing you how to create plots to analyze and simulate a future frequency like the one below.
Function Improvements: tk_make_future_timeseries()
tk_make_future_timeseries() is a function designed to make your life easier when creating a future time series from an existing one. It evaluates the periodicity of the existing time series and then creates a future time series that matches the frequency. While it works with all frequencies from seconds to years, the biggest benefit is with daily time series.
tk_make_future_timeseries() function is discussed at length in the vignette so we’ll just go over the changes briefly. To summarize, the function already had the argument
inspect_weekdays to look at days that are missing on a weekly, bi-weekly, tri-weekly and quad-weekly frequency. Now it has
inspect_months to look for days that are missing on a monthly, quarterly, or yearly schedule. Further, the function already had a
skip_values argument to skip irregular time sequences such as holidays. Now it has
insert_values to add back in dates that might be incorrectly skipped by the algorithm.
The handling of the
n_future argument was changed to now produce an end date that is the number of periods including days removed from
skip_days. This helps with keeping a constant end date while varying the inspection and skip days, which is more intuitive when creating a future time series. Here’s a brief example with
n_future = 90 using the FB stock from the FANG dataset in the
tidyquant package. Note that the end date is always 90 total periods (“2017-03-30”) from the index end date.
Function Improvements: tk_get_timeseries_signature()
We’ve included a few new features that are output when using
tk_get_timeseries_signature(). The full list of features can be found on our pkgdown site. The new features include:
- hour12: The hour component on a 12 hour scale.
- am.pm: Morning (AM) = 1, Afternoon (PM) = 2.
- qday: The day of the quarter.
- mweek: The week of the month.
- mday7: The integer division of day of the month by seven. Returns the first, second, third, … instance that the day has appeared in the month. Values begin at 1. For example, the first Saturday in the month has mday7 = 1. The second Saturday has mday7 = 2.
We are now up to 28 features (including the original index) that can be data mined for relationships with the target (response or independent variable).
If you are interested in learning more about
- Visit our pkgdown site for detailed documentation
- Visit our GitHub site for code updates
- Visit our website for news and announcements
If you’re interested in meeting with the members of Business Science, we’ll be speaking at the following upcoming conferences:
- R/Finance: Chicago, May 19-20
- Enterprise Applications of the R Language (EARL): San Francisco, June 5-7
- @bizScienc is on twitter and LinkedIn!
- Sign up for our insights blog to stay updated!
- If you like our software, star our GitHub packages :)