Create accountLogin

Recent searches

No recent searches

Search options

Only available when logged in.
universeodon.com is part of the decentralized social network powered by Mastodon.
Be one with the #fediverse. Join millions of humans building, creating, and collaborating on Mastodon Social Network. Supports 1000 character posts.

Administered by:

Server stats:

3.7K
active users
Learn more

universeodon.com: AboutStatusProfiles directoryPrivacy policy

Mastodon: AboutGet the appKeyboard shortcutsView source codev4.2.17

#bigquery

0 posts0 participants0 posts today
N-gated Hacker News<p>🍕🎨 "Map of Python" is the digital dabbling of a cartographer, lost in the vast jungle of 500,000+ <a href="https://mastodon.social/tags/Python" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Python</span></a> packages, desperately trying to create art from JSON blobs. 🧩🤷‍♂️ But hey, at least there's <a href="https://mastodon.social/tags/BigQuery" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>BigQuery</span></a> to save the day from the horror of actually downloading data! 🚀🧐<br><a href="https://fi-le.net/pypi/" rel="nofollow noopener noreferrer" translate="no" target="_blank"><span class="invisible">https://</span><span class="">fi-le.net/pypi/</span><span class="invisible"></span></a> <a href="https://mastodon.social/tags/DataVisualization" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>DataVisualization</span></a> <a href="https://mastodon.social/tags/Cartography" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Cartography</span></a> <a href="https://mastodon.social/tags/ArtInTech" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>ArtInTech</span></a> <a href="https://mastodon.social/tags/HackerNews" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>HackerNews</span></a> <a href="https://mastodon.social/tags/ngated" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>ngated</span></a></p>
Data Recce<p>❌ No more manually cross-referencing dbt docs from dev and prod</p><p>❌ No more manually checking schemas in your data warehouse</p><p>❌ No more manually comparing row-counts on models.</p><p>See a trend? </p><p>Read how an experienced data professional validates zero regression on a <a href="https://mastodon.social/tags/dbt" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>dbt</span></a> PR:</p><p><a href="https://www.linkedin.com/posts/abdelm_recce-dbt-activity-7300436694808358914-aKiF?rcm=ACoAAAVLBgkB6r61wCsOcKgFDrtf_EEEe3UjdXs" rel="nofollow noopener noreferrer" translate="no" target="_blank"><span class="invisible">https://www.</span><span class="ellipsis">linkedin.com/posts/abdelm_recc</span><span class="invisible">e-dbt-activity-7300436694808358914-aKiF?rcm=ACoAAAVLBgkB6r61wCsOcKgFDrtf_EEEe3UjdXs</span></a></p><p><a href="https://mastodon.social/tags/DataEngineering" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>DataEngineering</span></a> <a href="https://mastodon.social/tags/dbt" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>dbt</span></a> <a href="https://mastodon.social/tags/Data" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Data</span></a> <a href="https://mastodon.social/tags/Analytics" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Analytics</span></a> <a href="https://mastodon.social/tags/AnalyticsEngineering" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>AnalyticsEngineering</span></a> <a href="https://mastodon.social/tags/SQL" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>SQL</span></a> <a href="https://mastodon.social/tags/BigQuery" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>BigQuery</span></a> <a href="https://mastodon.social/tags/OpenSource" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>OpenSource</span></a></p>
emmuzoo<p>📊 Exploring dbt for Data Transformation<br>The journey continues! In this part of the project, I'm learning how dbt models help automate data transformation. I'm building out models in dbt for these taxi datasets to create clean, analysis-ready data in <a href="https://mastodon.social/tags/BigQuery" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>BigQuery</span></a>. It’s fascinating to see how everything connects! <a href="https://mastodon.social/tags/DataEngineering" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>DataEngineering</span></a> <a href="https://mastodon.social/tags/dbt" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>dbt</span></a> <a href="https://mastodon.social/tags/GCP" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>GCP</span></a> <a href="https://mastodon.social/tags/ETL" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>ETL</span></a> <a href="https://mastodon.social/tags/DataTalksClub" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>DataTalksClub</span></a></p>
emmuzoo<p>🚀 Started Module 4 of <a href="https://mastodon.social/tags/DataEngineering" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>DataEngineering</span></a> Zoomcamp!<br>Just kicked off the Analytics Engineering module and I'm diving into transforming the Green Taxi, Yellow Taxi, and FHV NY Taxi datasets loaded in <a href="https://mastodon.social/tags/BigQuery" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>BigQuery</span></a>. Excited to see how dbt can help create analytical views for better decision-making! <a href="https://mastodon.social/tags/dbt" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>dbt</span></a> <a href="https://mastodon.social/tags/DataTalksClub" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>DataTalksClub</span></a> <a href="https://mastodon.social/tags/GCP" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>GCP</span></a> <a href="https://mastodon.social/tags/AnalyticsEngineering" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>AnalyticsEngineering</span></a> <a href="https://mastodon.social/tags/ETL" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>ETL</span></a></p>
:rss: Qiita - 人気の記事<p>【BigQuery】画像から類似画像を検索！マルチモーダルエンベディングの簡単解説<br><a href="https://qiita.com/te_yama/items/d320f81ddffae447b495?utm_campaign=popular_items&amp;utm_medium=feed&amp;utm_source=popular_items" rel="nofollow noopener noreferrer" translate="no" target="_blank"><span class="invisible">https://</span><span class="ellipsis">qiita.com/te_yama/items/d320f8</span><span class="invisible">1ddffae447b495?utm_campaign=popular_items&amp;utm_medium=feed&amp;utm_source=popular_items</span></a></p><p><a href="https://rss-mstdn.studiofreesia.com/tags/qiita" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>qiita</span></a> <a href="https://rss-mstdn.studiofreesia.com/tags/Python" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Python</span></a> <a href="https://rss-mstdn.studiofreesia.com/tags/BigQuery" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>BigQuery</span></a> <a href="https://rss-mstdn.studiofreesia.com/tags/GoogleCloud" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>GoogleCloud</span></a> <a href="https://rss-mstdn.studiofreesia.com/tags/%E3%83%99%E3%82%AF%E3%83%88%E3%83%AB%E6%A4%9C%E7%B4%A2" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>ベクトル検索</span></a></p>
The OpenAIRE Graph<p>This week! Join us on 19 February for our <a href="https://mastodon.social/tags/CommunityCall" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>CommunityCall</span></a>! This month, we'll present the different avenues for accessing the <a href="https://mastodon.social/tags/OpenAIREGraph" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>OpenAIREGraph</span></a>'s data (such as <a href="https://mastodon.social/tags/API" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>API</span></a>, <a href="https://mastodon.social/tags/Zenodo" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Zenodo</span></a>, <a href="https://mastodon.social/tags/GoogleCloud" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>GoogleCloud</span></a>, etc.) with a brief recap of our <a href="https://mastodon.social/tags/BigQuery" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>BigQuery</span></a> training from October. Register now! Registration and agenda in link below,</p><p>Register now <a href="https://tinyurl.com/y27vxyrp" rel="nofollow noopener noreferrer" translate="no" target="_blank"><span class="invisible">https://</span><span class="">tinyurl.com/y27vxyrp</span><span class="invisible"></span></a></p>
Gus<p>🚀 DataTalksClub's Data Engineering Zoomcamp Week 3 - BigQuery as a data warehousing solution.</p><p>🎯 For this week's module, we used Google's BigQuery to read Parquet files from a GCS bucket, and compare querying on regular, external and partitioned/clustered tables.</p><p>🔗 My answers to this module: <a href="https://github.com/goosethedev/de-zoomcamp-2025/blob/ecb1f1f3fc69b8d10703eb07328567dab2acf688/03-data-warehousing/README.md" rel="nofollow noopener noreferrer" translate="no" target="_blank"><span class="invisible">https://</span><span class="ellipsis">github.com/goosethedev/de-zoom</span><span class="invisible">camp-2025/blob/ecb1f1f3fc69b8d10703eb07328567dab2acf688/03-data-warehousing/README.md</span></a></p><p><a href="https://mastodon.social/tags/dataengineering" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>dataengineering</span></a> <a href="https://mastodon.social/tags/bigquery" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>bigquery</span></a> <a href="https://mastodon.social/tags/bootcamp" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>bootcamp</span></a> <a href="https://mastodon.social/tags/bash" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>bash</span></a> <a href="https://mastodon.social/tags/python" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>python</span></a></p>
The OpenAIRE Graph<p>Join us on 19 February for our <a href="https://mastodon.social/tags/CommunityCall" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>CommunityCall</span></a>! This month, we'll present the different avenues for accessing the <a href="https://mastodon.social/tags/OpenAIREGraph" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>OpenAIREGraph</span></a>'s data (such as <a href="https://mastodon.social/tags/API" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>API</span></a>, <a href="https://mastodon.social/tags/Zenodo" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Zenodo</span></a>, <a href="https://mastodon.social/tags/GoogleCloud" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>GoogleCloud</span></a>, etc.) with a brief recap of our <a href="https://mastodon.social/tags/BigQuery" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>BigQuery</span></a> training from October. Register now! Registration and agenda in link below,</p><p>Register now <a href="https://tinyurl.com/y27vxyrp" rel="nofollow noopener noreferrer" translate="no" target="_blank"><span class="invisible">https://</span><span class="">tinyurl.com/y27vxyrp</span><span class="invisible"></span></a></p>
Neil Craig<p>FFS. Turns out (after I built a feature) that you can't supply a schema for BigQuery Materialised Views.</p><p>&gt; Error: googleapi: Error 400: Schema field shouldn't be used as input with a materialized view, invalid</p><p>So it's impossible to have column descriptions for MVs? That sucks.</p><p><a href="https://mastodon.social/tags/BigQuery" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>BigQuery</span></a></p>
Neil Craig<p>Whilst migrating our log pipeline to use the BigQuery Storage API &amp; thus end-to-end streaming of data from Storage (GCS) via Eventarc &amp; Cloud Run (read, transform, enrich - NodeJS) to BigQuery, I tested some big files, many times the largest we've ever seen in the wild.</p><p>It runs at just over 3 log lines/rows per millisecond end-to-end (i.e. inc. writing to BigQuery) over 3.2M log lines.</p><p>Would be interested to know how that compares with similar systems.</p><p><a href="https://mastodon.social/tags/BBC" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>BBC</span></a> <a href="https://mastodon.social/tags/NodeJS" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>NodeJS</span></a> <a href="https://mastodon.social/tags/BigQuery" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>BigQuery</span></a> <a href="https://mastodon.social/tags/GoogleCloud" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>GoogleCloud</span></a></p>
Jules<p>We released our product as Open Source today!</p><p>So if you're into Google Analytics and Big Query: check it out, it's free to use.</p><p>Tags: <a href="https://mastodon.social/tags/gpl" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>gpl</span></a> <a href="https://mastodon.social/tags/ga4" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>ga4</span></a> <a href="https://mastodon.social/tags/bigquery" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>bigquery</span></a> <a href="https://mastodon.social/tags/measure" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>measure</span></a> <a href="https://mastodon.social/tags/sql" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>sql</span></a> <a href="https://mastodon.social/tags/dbt" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>dbt</span></a> <a href="https://mastodon.social/tags/dataform" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>dataform</span></a> </p><p><a href="https://ga4dataform.com/were-open-source-ga4dataform-community-is-released/" rel="nofollow noopener noreferrer" translate="no" target="_blank"><span class="invisible">https://</span><span class="ellipsis">ga4dataform.com/were-open-sour</span><span class="invisible">ce-ga4dataform-community-is-released/</span></a></p>
Nicolas Fränkel 🇺🇦🇬🇪<p>What's the best way to wake up than to try to fix a failing GitHub Workflow, and to finally realize <a href="https://mastodon.top/tags/Google" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Google</span></a> deleted the underlying <a href="https://mastodon.top/tags/BigQuery" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>BigQuery</span></a> table because the default expiration date is 60 days?</p><p>Can't there be a big warning when you create the table? 🤬</p><p><a href="https://mastodon.top/tags/DXFailure" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>DXFailure</span></a> IMHO</p>
PPC Land<p>Google Analytics updates BigQuery Export with enhanced traffic source analysis: Learn about the latest Google Analytics BigQuery export enhancement adding session-scoped traffic source fields for deeper insights. <a href="https://ppc.land/google-analytics-updates-bigquery-export-with-enhanced-traffic-source-analysis/?utm_source=dlvr.it&amp;utm_medium=mastodon" rel="nofollow noopener noreferrer" translate="no" target="_blank"><span class="invisible">https://</span><span class="ellipsis">ppc.land/google-analytics-upda</span><span class="invisible">tes-bigquery-export-with-enhanced-traffic-source-analysis/?utm_source=dlvr.it&amp;utm_medium=mastodon</span></a> <a href="https://mastodon.social/tags/GoogleAnalytics" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>GoogleAnalytics</span></a> <a href="https://mastodon.social/tags/BigQuery" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>BigQuery</span></a> <a href="https://mastodon.social/tags/DataAnalytics" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>DataAnalytics</span></a> <a href="https://mastodon.social/tags/TrafficSource" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>TrafficSource</span></a> <a href="https://mastodon.social/tags/DigitalMarketing" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>DigitalMarketing</span></a></p>
Valentin Deleplace<p>I published "Faster results with Short query optimized mode in BigQuery"</p><p><a href="https://medium.com/google-cloud/faster-results-with-short-query-optimized-mode-in-bigquery-97b7198551b7" rel="nofollow noopener noreferrer" translate="no" target="_blank"><span class="invisible">https://</span><span class="ellipsis">medium.com/google-cloud/faster</span><span class="invisible">-results-with-short-query-optimized-mode-in-bigquery-97b7198551b7</span></a></p><p><a href="https://hachyderm.io/tags/BigQuery" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>BigQuery</span></a> <a href="https://hachyderm.io/tags/GoogleCloud" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>GoogleCloud</span></a> <a href="https://hachyderm.io/tags/SQL" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>SQL</span></a> <a href="https://hachyderm.io/tags/performance" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>performance</span></a></p>
Valentin Deleplace<p>I published "Intelligible advanced SQL queries with pipe syntax"<br><a href="https://hachyderm.io/tags/SQL" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>SQL</span></a> <a href="https://hachyderm.io/tags/BigQuery" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>BigQuery</span></a></p><p><a href="https://medium.com/google-cloud/intelligible-advanced-sql-queries-with-pipe-syntax-86d3a431b660" rel="nofollow noopener noreferrer" translate="no" target="_blank"><span class="invisible">https://</span><span class="ellipsis">medium.com/google-cloud/intell</span><span class="invisible">igible-advanced-sql-queries-with-pipe-syntax-86d3a431b660</span></a></p>
Denis 🌏<p>Google did finally post an outage status report 🙄 </p><p><a href="https://hachyderm.io/tags/gcp" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>gcp</span></a> <a href="https://hachyderm.io/tags/bigQuery" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>bigQuery</span></a></p>
Denis 🌏<p>Anyone else who use BigQuery seeing elevated errors? 502s?</p><p><a href="https://hachyderm.io/tags/gcp" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>gcp</span></a> <a href="https://hachyderm.io/tags/bigQuery" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>bigQuery</span></a> </p><p>(I do miss the days when Twitter was a reliable communication path for finding out down-for-everyone-or-just-me?)</p>
Guia de TI<p>Webinar de Google Cloud Fundamentals Gratuito da Fast Lane</p><p><a href="https://guiadeti.com.br/webinar-google-cloud-fundamentals-gratuito/?feed_id=10029&amp;_unique_id=675709187aa29" rel="nofollow noopener noreferrer" translate="no" target="_blank"><span class="invisible">https://</span><span class="ellipsis">guiadeti.com.br/webinar-google</span><span class="invisible">-cloud-fundamentals-gratuito/?feed_id=10029&amp;_unique_id=675709187aa29</span></a></p><p><a href="https://flipboard.social/tags/bigquery" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>bigquery</span></a> <a href="https://flipboard.social/tags/cloud" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>cloud</span></a> <a href="https://flipboard.social/tags/cloudcomputing" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>cloudcomputing</span></a> <a href="https://flipboard.social/tags/googlecloud" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>googlecloud</span></a> <a href="https://flipboard.social/tags/tecnologia" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>tecnologia</span></a><br><a href="https://guiadeti.com.br/webinar-google-cloud-fundamentals-gratuito/?feed_id=10029&amp;_unique_id=675709187aa29" rel="nofollow noopener noreferrer" translate="no" target="_blank"><span class="invisible">https://</span><span class="ellipsis">guiadeti.com.br/webinar-google</span><span class="invisible">-cloud-fundamentals-gratuito/?feed_id=10029&amp;_unique_id=675709187aa29</span></a></p>
Neil Craig<p>After several iterations, I think I've finally got my log ingest pipeline working properly, at scale, using the <a href="https://mastodon.social/tags/BigQuery" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>BigQuery</span></a> Storage API.<br>Some complications with migrating from the "legacy" "streaming" (it's not in the sense of code) API have been really hard to deal with e.g.:<br>* A single row in a write fail means the entire write fails<br>* SQL column defaults don't apply unless you specifically configure them to<br>* 10MB/write limit<br>I rewrote the whole thing today &amp; finally things are looking good! 🤞</p>
Joe<p><a href="https://functional.cafe/tags/Snowflake" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Snowflake</span></a> <a href="https://functional.cafe/tags/Terraform" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Terraform</span></a> and <a href="https://functional.cafe/tags/BigQuery" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>BigQuery</span></a></p>
ExploreLive feeds
About