Scheduled API collector
Query an open API every day and store the history in SQLite, with an error log.
All pathsDiscover Coursera PlusAfter step 1 After step 2 After step 3 After step 4
Data & AI · 07Beginner
Data Engineer
Developers who want to build pipelines rather than models.
Robust, tested Python, large-scale data preparation, then functional programming and Spark in Scala.
472hours of coursework
48weeks at 10 h
4steps
19courses
3universities
Target skills
Data ProcessingDebuggingData StructuresData CleansingProgramming PrinciplesData VisualizationWeb ScrapingData PresentationPython ProgrammingPandasNumPyData Manipulation
Skill labels as listed on Coursera.
Target jobs
- Data engineer
- Big data engineer
- Back-end data developer
Progression
- 1University of MichiganBeginnerPython, SQL, SQLite
Stated prerequisites: No prerequisites; designed as an on-ramp to programming
Show the 5 courses
Course Level Length Rating (reviews) Programming for Everybody (Getting Started with Python) Beginner 17 h 4.8 (233,775) Python Data Structures Beginner 20 h 4.9 (97,365) Using Python to Access Web Data Beginner 19 h 4.8 (44,591) Using Databases with Python Beginner 14 h 4.8 (21,659) Capstone: Retrieving, Processing, and Visualizing Data with Python Beginner 9 h 4.7 (14,483) - 2University of MichiganIntermediatePython, NumPy, pandas, SciPy, Jupyter
Stated prerequisites: Python 3 Programming specialization or equivalent Python basics
Show the 4 courses
Course Level Length Rating (reviews) Python Debugging: A Systematic Approach Intermediate 20 h 3.8 (12) NumPy and Pandas Basics for Future Data Scientists Intermediate 19 h 4.2 (14) Statistics with Python Using NumPy, Pandas, and SciPy Intermediate 20 h — Python Debugging Capstone Project: Fixing and Extending Code Intermediate 15 h — - 3University of Colorado BoulderBeginnerPython, pandas, NumPy, Seaborn
Stated prerequisites: Python fundamentals and statistics
Show the 5 courses
Course Level Length Rating (reviews) Fundamental Tools of Data Wrangling Beginner 27 h 4.3 (22) Data Collection and Integration Intermediate 28 h 4.5 (16) Data Understanding and Visualization Intermediate 25 h — Data Processing and Manipulation Intermediate 29 h — Data Wrangling with Python Project Intermediate 26 h — - 4École Polytechnique Fédérale de LausanneIntermediateScala, Apache Spark, Apache Hadoop
Stated prerequisites: At least one year of programming experience
Show the 5 courses
Course Level Length Rating (reviews) Functional Programming Principles in Scala Intermediate 56 h 4.8 (8,271) Functional Program Design in Scala Intermediate 35 h 4.5 (3,137) Parallel programming Intermediate 33 h 4.4 (1,844) Big Data Analysis with Scala and Spark Intermediate 28 h 4.6 (2,600) Functional Programming in Scala Capstone — 32 h 4.4 (547)
With Coursera Plus
This path takes 472 hours, about 11 months at 10 hours a week. A Coursera Plus subscription gives access to most of its courses during that time.
Projects to build
Tested library
Turn scripts into a clean Python module covered by pytest tests.
ETL pipeline
Extract CSV and JSON files, clean them and load them into a database, with data quality checks.
Spark job
Aggregate several gigabytes of open taxi trip data with Spark in Scala and compare run times.
Free textbooks
Python for EverybodyCharles R. SeveranceFree, CC BY 4.0
Python for Data Analysis, 3rd ed.Wes McKinneyOpen access online
Software Engineering at GoogleT. Winters, T. Manshreck, H. Wright (eds.)Free online, CC BY-NC-ND 4.0