Google Bigquery Legacy SQL - 如果没有返回结果,如何返回 null 或零?

Posted

技术标签:

【中文标题】Google Bigquery Legacy SQL - 如果没有返回结果,如何返回 null 或零?【英文标题】:Google Bigquery Legacy SQL - How to return a null or zero if no results returned? 【发布时间】:2018-03-27 12:18:50 【问题描述】:

假设我有下表

month    region   revenue   
------  -------- ---------- 
 jan     north      100
 feb     north      150
 mar     north      250

如何查询上表得到以下结果?:

month    region   revenue   
------  -------- ---------- 
 jan     north      100
 feb     north      150
 mar     north      250
 apr     north       0
 may     north       0
 jun     north       0

0 可以是空值,反之亦然。本质上是尝试将空/空字段添加到我的查询中(在本例中为 apr、may、jun 行)。任何帮助将不胜感激

谢谢

【问题讨论】:

【参考方案1】:

以下是 BigQuery Legacy SQL,但请注意 - 强烈建议 BigQuery 团队迁移到 BigQuery Standard SQL

下面的例子应该会给你一个想法

#legacySQL
SELECT 
  months.month_abr AS month_abr, 
  regions.region AS region, 
  COALESCE(revenues.revenue, 0) revenue
FROM months
CROSS JOIN (
  SELECT region FROM revenues
) regions
LEFT JOIN revenues
ON months.month_abr = revenues.month_abr
AND regions.region = revenues.region
-- ORDER BY regions.region, months.month_number

revenues 是包含收入数据的原始表,month 是包含月份列表的表(或者您可以使用下面示例中的子查询)

您可以使用下面的示例使用您问题中的虚拟数据来测试/玩上面的内容

#legacySQL
SELECT 
  months.month_abr AS month_abr, 
  regions.region AS region, 
  COALESCE(revenues.revenue, 0) revenue
FROM (
  SELECT month_number, month_abr FROM 
  (SELECT 1 month_number, 'jan' month_abr),
  (SELECT 2 month_number, 'feb' month_abr),
  (SELECT 3 month_number, 'mar' month_abr),
  (SELECT 4 month_number, 'apr' month_abr),
  (SELECT 5 month_number, 'may' month_abr),
  (SELECT 6 month_number, 'jun' month_abr)  
) AS months
CROSS JOIN (
  SELECT region FROM (
    SELECT region FROM 
    (SELECT 'jan' month_abr, 'north' region, 100 revenue),
    (SELECT 'feb' month_abr, 'north' region, 150 revenue),
    (SELECT 'mar' month_abr, 'north' region, 250 revenue)
  ) GROUP BY region
) regions
LEFT JOIN (
  SELECT month_abr, region, revenue FROM 
  (SELECT 'jan' month_abr, 'north' region, 100 revenue),
  (SELECT 'feb' month_abr, 'north' region, 150 revenue),
  (SELECT 'mar' month_abr, 'north' region, 250 revenue)
) AS revenues
ON months.month_abr = revenues.month_abr
AND regions.region = revenues.region
ORDER BY regions.region, months.month_number

结果如下

Row month_abr   region  revenue  
1   jan         north   100  
2   feb         north   150  
3   mar         north   250  
4   apr         north   0    
5   may         north   0    
6   jun         north   0    

最后 - 下面是 BigQuery 标准 SQL 的外观

#standardSQL
WITH regions AS (
  SELECT DISTINCT region FROM revenues
), months AS (
SELECT EXTRACT(MONTH FROM month) month_number,
  LOWER(FORMAT_DATE('%b', month)) month_abr
  FROM UNNEST(GENERATE_DATE_ARRAY(DATE '2010-01-01', DATE '2010-12-01', INTERVAL 1 MONTH)) month
)
SELECT month_abr, region, COALESCE(revenues.revenue, 0) revenue
FROM months
CROSS JOIN regions
LEFT JOIN revenues
USING(month_abr, region)
ORDER BY region, month_number

您可以使用问题中的虚拟数据进行测试和玩游戏

#standardSQL
WITH revenues AS (
  SELECT 'jan' month_abr, 'north' region, 100 revenue UNION ALL
  SELECT 'feb', 'north', 150 UNION ALL
  SELECT 'mar', 'north', 250 
), regions AS (
  SELECT DISTINCT region FROM revenues
), months AS (
SELECT EXTRACT(MONTH FROM month) month_number,
  LOWER(FORMAT_DATE('%b', month)) month_abr
  FROM UNNEST(GENERATE_DATE_ARRAY(DATE '2010-01-01', DATE '2010-12-01', INTERVAL 1 MONTH)) month
)
SELECT month_abr, region, COALESCE(revenues.revenue, 0) revenue
FROM months
CROSS JOIN regions
LEFT JOIN revenues
USING(month_abr, region)
ORDER BY region, month_number

您应该能够将上述应用到您的实际用例中

【讨论】:

谢谢,在这里使用了你的第二个代码块和你的答案:***.com/questions/38306016/… 得到我想要的。【参考方案2】:

一个选项 - 使用您想要通过的值列表运行 LEFT/RIGHT JOIN。

让我们从缺少空值/零的查询开始:

#standardSQL
SELECT year, SUM(number) c
FROM `bigquery-public-data.usa_names.usa_1910_current`
WHERE name='Felipe'
AND year>2014
GROUP BY year 
ORDER BY year

如果我们想为 2015 年之前的值获取 0:

SELECT b.year, IFNULL(c, 0) c
FROM (
  SELECT year, SUM(number) c
  FROM `bigquery-public-data.usa_names.usa_1910_current`
  WHERE name='Felipe'
  AND year>2014
  GROUP BY year 
) a
RIGHT JOIN (
  SELECT year FROM UNNEST(GENERATE_ARRAY(2012, 2016)) year
) b
ON a.year=b.year
ORDER BY year

相关的子查询也可以节省时间:

SELECT year, (
  SELECT IFNULL(SUM(number), 0) 
  FROM `bigquery-public-data.usa_names.usa_1910_current` a
  WHERE name='Felipe'
  AND year>2014
  AND a.year=b.year
) c
FROM (SELECT year FROM UNNEST(GENERATE_ARRAY(2012, 2016)) year) b
ORDER BY year

【讨论】:

感谢您的解决方案,但不幸的是我使用的是旧版 sql 是的 - 在阅读 Mikhaik 的回答之前,我没有注意到标题中的遗留问题

以上是关于Google Bigquery Legacy SQL - 如果没有返回结果,如何返回 null 或零?的主要内容,如果未能解决你的问题,请参考以下文章

如何通过 BigQuery 连接将 use_legacy_sql=False 传递给 Airflow DAG 中的 SqlSensor?

如何在 Bigquery Legacy SQL 中创建真正的函数

Bigquery Standard Sql 等效于 Legacy Sql 中的 LAST()

BigQuery Legacy SQL(子查询?)中占总数的百分比

Bigquery Standard Sql 等效于 Legacy Sql 中的 GROUP_CONCAT_UNQUOTED

BigQuery bq SSL 问题