Responsibilities:
Use Databricks Delta Live Tables to manage unstructured blob data.
Lead the data migration efforts for different teams in the Databricks Lakehouse to get data from API/event hubs/Azure blob storage/unstructured data.
Advanced Building of lake-house architecture for the team for a single source of truth of data using Azure Databricks.
Managing and handling expectations of teammates and external teams to set project timeline.
Advanced Scripting programs in Python and SQL to get daily active user data from Tableau API to Azure.
Extensively using Azure Data Factory pipelines to get data from Azure Blobs and Azure data Kusto explorer cluster to Azure SQL database.
Creating Extracts and Tableau jobs after filtering data via SQL for the BI team to develop Tableau dashboards.
Updating tables and SQL Queries and table structures for the team thus saving CPU processing time.
Updating multiple pipelines from full refresh to incremental refresh for the team -saving time, disk space and money.
Extensively using Azure Logic Apps to create custom notifications for the Azure data factory pipelines.
Creating incremental refresh automation for tables from Azure data explorer cluster to Azure SQL tables without changing data capture (Watermarking).
Using structured thinking to solve complex business data problems and architect the data for the team.
Using Azure logic app and Power Automate flows to get data from emails and SharePoint to SQL database.
Moving tableau table calculations to the backend - Databricks for faster dashboard loading.
Monitor and assess Data pipeline performance; identify problems and institute corrective actions as required.
Identify, track, and manage risk.
Responsible for understanding and interpreting customer/business data requirements to work in partnership with customers/business towards derived solutions and leveraging existing solutions.
Responsible for the direction, oversight, and outcome of all assigned tasks.
Honeywell International" Licensed Clinical Psychologist Wage: Between $90-$185 an hour Licensed Clinical Psychologists Are you ready to launch or expand your private practice? Headway is here to help you start accepting insurance with ease, increase your earnings with higher...
...Instrumentation & Controls Project Engineer/Manager role at Hazen and Sawyer4 days... ...include both in-plant and remote telemetry (SCADA) projects with... ...locationSeniority level Seniority level Mid-Senior level... ...00-$186,000.002 days agoEntry Level Electrical Engineer, application...
As a Front-End Developer, you will be responsible for designing, implementing, and maintaining user-facing features of web and mobile applications. You will collaborate closely with designers, back-end developers, and other stakeholders to create seamless and engaging user...
...charging stations, etc. supporting Verizon, AT&T and Dish Network. They will be working with a journeyman, a master electrician, electrical helper, and or construction manger on various sights through out the BAWA market. They will be out in the field digging trenches...
...control of your career? Great Lakes Roofing Corp. (Germantown, WI) is hiring immediately for a seasoned and forward-thinking People & Culture Leader to design & implement professional team development while driving HR strategies and policies via training, mentorship, and...