Data engineering and Power BI on Azure Databricks.
4 years of data engineering since 2022, about 3 of them as lead Databricks and BI developer
From integrations with enterprise systems to reports and applications. Experience in the energy sector.
Write to mattia@boniotti.dev LinkedIn
- Role
- Freelance data engineer
- Sector
- Energy, open to other sectors
- Base
- Brescia, remote for clients in Italy and the EU
Services
-
Pipelines and integrations on Databricks
Flows from SAP, Azure Data Factory, Control-M, SFTP, SharePoint and many other systems, through to data ready for analysis.
-
Migration to Databricks
Migration of existing flows, for example from Cloudera/Scala to PySpark.
-
Power BI reports
Data modelling, advanced DAX, direct connection to the data produced on Databricks. More than 100 different reports built.
-
Web applications on top of the data
Java Spring Boot and Angular applications on top of the data, for when a dashboard is not enough.
Experience
4 years of data engineering (since 2022), with full-stack Java/Angular development in parallel. About 3 of them as lead Databricks and BI developer in the energy sector, for a large Italian industrial group.
Projects in the energy sector
- Pipelines and reports on energy market data (electricity and gas, Italy and Europe), with forecasting models, web applications and deployment.
- Processing and analysis of data on plants and environmental indicators.
- Market analysis with a geographic component.
- Migration of data flows from Cloudera/Scala to PySpark on Azure Databricks.
Also. Power BI reports supporting other teams in the energy sector. Currently developing full-stack Java/Angular.
Context. Enterprise environments with structured processes: change management, access management on Azure AD, coordination with infrastructure and offshore teams.
Stack
Data platform
- Azure Databricks
- PySpark
- Azure Data Factory
- Azure Data Lake
- Synapse
Languages and frameworks
- Python
- SQL/T-SQL
- Java Spring Boot
- Angular/TypeScript
Reporting and automation
- Power BI (DAX)
- Power Automate
Version control and delivery
- Git
- Docker
- Azure DevOps Pipelines
Messaging and databases
- Kafka
- MongoDB
About
Freelance data engineer in Brescia, working remotely for clients in Italy and the EU.
I am at ease in enterprise environments, where processes and responsibilities are defined.
I cover the whole data chain: integration, processing, reporting and applications.
Contact
For a role or a project, write to me directly. A few lines on the context and the stack are enough.