Welcome to my portfolio! I am Abhishek, a Senior Data Engineer with expertise in Python, Spark, SQL, and AWS. I am also an AWS Certified Solutions Architect – Associate. This repository showcases some of my projects and skills.
Projects
realtime-log-analytics
- Repository: realtime-log-analytics
- Description: This project implements a real-time log analytics pipeline using PySpark, Spark Structured Streaming, and Delta Lake on Databricks. The pipeline follows a Medallion (Bronze-Silver-Gold) architecture, enabling efficient data ingestion, transformation, and aggregation for log data. It’s designed to process and analyze logs at scale, providing insights such as log counts by severity level.
airflow_data_pipeline
online_table_reservation_system
Tic-Tac-Toe Game
A classic Tic-Tac-Toe game implemented in Python. This project demonstrates my ability to create interactive applications and showcases my Python programming skills.
- Repository: tic-tac-toe-python
- Description: A console-based Tic-Tac-Toe game where players take turns to enter cell numbers (1-9) to place their marks. The game checks for winning conditions and displays the game board after each move.
- Features:
- Interactive game play
- Input validation
- Win and draw detection
Skills
- Python: Proficient in Python programming, including data manipulation, algorithm development, and application design.
- Spark: Experienced with Apache Spark for large-scale data processing and analytics.
- SQL: Skilled in writing complex SQL queries, database design, and optimization.
- AWS: AWS Certified Solutions Architect – Associate. Experienced in deploying, managing, and scaling applications on AWS.
Certifications
- AWS Certified Solutions Architect – Associate
- IBM Data Science Certificate (Coursera)
YouTube Channel
Check out my YouTube channel, Tech Jaala, where I create content related to Python programming and various tech tutorials.
Feel free to connect with me or reach out if you have any questions: