T-SQL Bitwise Operations
I've seen bit-product columns from time-to-time, mostly in SQL Server 2000 system tables, but it's never been something I've had to work with. And when I've needed to, I've known how to figure out which options are selected, i.e. a bit product of 9 means options 8 and 1 are selected. If you've ever taken a look at the [status] column on the sysdatabases table (SQL 2000), you'll know what I'm talking about.
What I've never known how to do, until recently, was calculate these options programmatically. That's why, when I noticed the [freq_interval] on the sysschedules table was a bit-product column, I decided to spend a little time figuring it out. Fortunately for me, a couple of my awesome co-workers, Jeff M. and Jason H., have worked with this before and were able to explain it to me. And, it turns out, it's actually quite easy.
Let me back up a few steps in case you're not familiar with this topic. If you check out the Books Online entry for the sysschedules table (2005), you'll notice the following statement:
freq_interval is one or more of the following:
1 = Sunday
2 = Monday
4 = Tuesday
8 = Wednesday
16 = Thursday
32 = Friday
64 = Saturday
When I looked at the actual value in the table, the schedule has a [freq_interval] value of 42, which is the sum of the bit values for the days selected.
If there were more than 7 options, the bit values would continue to double, i.e. 128, 256, etc. And regardless of how many bit values you select, you're guaranteed one and only one possible answer, as the sum of all previous bit values will never exceed the next bit value:
1 + 2 = 3
1 + 2 + 4 = 7
1 + 2 + 4 + 8 = 15
Knowing this, I'm able to retrieve the values manually: I start with the highest bit value that does not exceed 42, then subtract it; I repeat until I'm left with 0.
So...
42 - 32 = 10
10 - 8 = 2
2 - 2 = 0
That means my job is scheduled to run on Friday's (32), Wednesday's (8), and Monday's (2).
Now how do I do this with T-SQL? SQL Server provides an operator specifically for this task: the bitwise AND operator (&). For now, I'm going to skip the "why" behind this and just get to the practical application. If you're interested in the "why," let me know and I'll write a follow-up post on binary and logical AND and OR operations.
For example, to use the bitwise AND to find out which days are selected...
Select 42 & 1 As 'Sunday' , 42 & 2 As 'Monday' , 42 & 4 As 'Tuesday' , 42 & 8 As 'Wednesday' , 42 & 16 As 'Thursday' , 42 & 32 As 'Friday' , 42 & 64 As 'Saturday';
... will return ...
Sunday Monday Tuesday Wednesday Thursday Friday Saturday ----------- ----------- ----------- ----------- ----------- ----------- ----------- 0 2 0 8 0 32 0
If the result is not equal to zero, then that day is selected. Easy as key lime pie, right?
Now let's take it a step further and create our own working example. Let's say we're going to track the characteristics of various objects in a single bit-product column (note: this is not necessarily the best way to accomplish this in the real world, but it's a good illustration). First, set up a table to use in our example. This table will have a column, [attributes], which will hold the sum of our bit values.
Create Table myTable ( id int identity(1,1) , item varchar(10) , attributes int ); Insert Into myTable Select 'Broccoli', 200 Union All Select 'Tomato', 193 Union All Select 'Car', 276 Union All Select 'Ball', 292;
Next, we're going to create a table variable that holds characteristics and their values. We'll then join these two tables together to see which attributes exist for each item.
Declare @statusLookup Table ( attribute int , value varchar(10) ); Insert Into @statusLookup Select 1, 'Red' Union All Select 4, 'Blue' Union All Select 8, 'Green' Union All Select 16, 'Metal' Union All Select 32, 'Plastic' Union All Select 64, 'Plant' Union All Select 128, 'Edible' Union All Select 256, 'Non-Edible'; Select a.item, b.value From myTable a Cross Join @statusLookup b Where a.attributes & b.attribute <> 0 Order By a.item , b.value
You should get this result:
item value ---------- ---------- Ball Blue Ball Non-Edible Ball Plastic Broccoli Edible Broccoli Green Broccoli Plant Car Blue Car Metal Car Non-Edible Tomato Edible Tomato Plant Tomato Red
Great, now we know broccoli is edible! Let's apply a little XML to clean up the results...
Select a.item , Replace( Replace( Replace(( Select value From @statusLookup AS b Where a.attributes & b.attribute <> 0 Order By b.value For XML Raw) , '"/><row value="', ', '), '<row value="', ''), '"/>', '') As 'attributes' From myTable a Order By a.item;
item attributes ---------------------------------------- Ball Blue, Non-Edible, Plastic Broccoli Edible, Green, Plant Car Blue, Metal, Non-Edible Tomato Edible, Plant, Red
Voila! There you have it, how to use the bitwise AND (&) operator to retrieve multiple values from a bit-product column. Pretty neat stuff!
Special thanks to Jeff M. and Jason H. for their assistance.
Happy Coding!
Michelle Ufford (aka SQLFool)
Source: http://sqlfool.com/2009/02/bitwise-operations/
Categories
- Business Intelligence
- Internals
- Miscellaneous
- PASS
- Performance & Tuning
- Presentations
- SQL 2008
- SQL Tips
- Syndication
- T-SQL Scripts
Subscribe to my blog!
| Like what you see? Subscribe! |
![]() |
Around the Web
Recent Tweets
- RT @Phil_Factor: SQL Server table columns under the hood http://t.co/vp7gQ77B < what a great post
- @tradney haha that's awesome :)
- OH: @AdamMachanic's #sqlpass session was one of the best I've ever seen.
Archives
- November 2011
- October 2011
- September 2011
- July 2011
- June 2011
- May 2011
- April 2011
- January 2011
- December 2010
- November 2010
- October 2010
- September 2010
- July 2010
- June 2010
- May 2010
- April 2010
- February 2010
- January 2010
- November 2009
- October 2009
- September 2009
- August 2009
- July 2009
- June 2009
- May 2009
- April 2009
- March 2009
- February 2009
- January 2009
- December 2008
- November 2008
- October 2008



February 4th, 2009 - 07:55
Great article and examples… next time just remember “thinking blogs” should only be posted after noon LOL
February 4th, 2009 - 12:20
Well, any 5 year old would argue with you about broccoli being edible and balls being blue, but there you go — what does a 5 year old know?
Great example of using this function and quite cute as well!
ê¿ê
February 5th, 2009 - 17:36
Michelle,nice post, see also my first post on sqlblog.com
Speed Up Performance And Slash Your Table Size By 90% By Using Bitwise Logic
http://sqlblog.com/blogs/denis_gobo/archive/2007/05/29/test.aspx
February 6th, 2009 - 07:58
Thanks, Denis, that’s great! The next task for me is to evaluate performance implications, and your article is giving me a jump start on that.
April 16th, 2009 - 11:01
Michelle,
Just saw this website today…its great, like your style!
I am kind of new to XML, couldn’t understand the & operator used in the below query: Can you please shed some light on this..
WHERE a.attributes & b.attribute 0
SELECT a.item
, REPLACE( REPLACE( REPLACE((
SELECT VALUE
FROM #statusLookup AS b
WHERE a.attributes & b.attribute 0
ORDER BY b.VALUE FOR XML Raw)
, ‘”/><row value=”‘, ‘, ‘), ”, ”)
AS ‘attributes’
FROM myTable a
ORDER BY a.item;
April 16th, 2009 - 11:42
Hi Ranga,
Thanks for the feedback! I’m glad you like the site.
The & operator actually has nothing to do with XML; in the example above, XML was just used to help format the result set. The & operator is returning the bitwise value if the bitwise product contains it. To expand on the example above…
Now run these 2 queries to better examine what we’re doing with the WHERE a.attributes & b.attribute <> 0 syntax:
The first query shows you the results of passing each of the values into the bitwise product, with the use of the & operator. The second query shows you only those values that are contained in the bitwise product, which means they are “selected.”
Does that help? If not, let me know and I’ll expand on it further.
April 20th, 2009 - 11:46
Thanks a lot for the explanation….
December 23rd, 2009 - 11:55
This area of programming is becoming a lost art. Storing and retreiving data by using bit masks (as this article describes) is still a common use of bitwise operators, but there are so many other uses, namely data manipulation and calculation, that are becoming forgotton.
February 12th, 2010 - 06:55
Here’s an interesting “bug” that I’ve found:
DECLARE @bitvar BIT
SET @bitvar = 6
PRINT @bitvar & 1
PRINT @bitvar & 2
PRINT @bitvar & 4
PRINT 6 & 1
PRINT 6 & 2
PRINT 6 & 4
February 16th, 2010 - 07:31
You can also do the same trick without creating a lookup table variable, like this:
[code]
declare @tmp table
(
val int,
color nvarchar(100)
)
insert into @tmp (val, color) VALUES (0, 'black')
insert into @tmp (val, color) VALUES (1, 'red')
insert into @tmp (val, color) VALUES (2, 'yellow')
insert into @tmp (val, color) VALUES (4, 'blue')
insert into @tmp (val, color) VALUES (8, 'white')
declare @newval int
set @newval = 6
select
*
from
@tmp t cross join
(SELECT (@newval) as val) n
where
t.val & n.val 0
[/code]
March 4th, 2010 - 00:20
Helpful article and examples, Thanks.
August 1st, 2010 - 09:25
DECLARE @bitvar BIT
SET @bitvar = 6
PRINT @bitvar & 1
PRINT @bitvar & 2
PRINT @bitvar & 4
PRINT CAST(6 AS BIT) & 1
PRINT CAST(6 AS BIT) & 2
PRINT CAST(6 AS BIT) & 4
This is one of many situations where we should cast values first.
March 8th, 2011 - 05:57
What to do if the data is bigger than the BIGINT Range?
April 29th, 2011 - 20:31
Thanks for sharing this post.It is really worth reading.