Hello, welcome to our forum.

It looks like you have registered but you have not yet posted and messages. Our requirements are that you must post at least two messages, to allow the moderators to review your registration, before you will be allowed access to the full range of forum areas.

Please make a couple of posts, until then you may see a notice that says you are banned from certain forum areas.

Thank you.

# Thread: Another Silly Math Question!

1. ## Another Silly Math Question!

Hi All!
I have a draw full of LTC 1298 12 bit A/D converters. So at 5.0 volts DC on the input of a channel the A/D give the digital number 4096. Okay so lets say you do see 5.00 volts on the input it seems the basic formula would be INPUT*10 divided by 4096 * 5 which would give 50 or 5.00 volts. However, at an input of 3.71 volts you have an A/D input of 3040. 3040*10= 30400. Now divide by 4096 you get 7.42 and the PIC will only give you the 7 so that 7*5=35 and not the 3.71 volts. So how do you create a formula that is accurate? Do you need to take your A/D reading and divide it or ....???

2. ## Re: Another Silly Math Question!

Hi Ed,
5V/4096=1.2207mV per count. You can use the ** operator to multiply by units of 1/65536, try something like Voltage = ADResult ** 8000.
Basically the ** operator multiplies by the value given and then divides the intermediate 32bit result by 65536 so doing ADResult ** 8000 would be the same as doing ADResult / 0.12207 if you could do that.

At 5V input you'll get a ADResult of 4096. 4096*8000/65536=500 representing 5.00V
At 3.71V input you'll get an ADResult of 3040. 3040*8000/65536=371 representing 3.71V

It's not perfect bu pretty close. How I came up with 8000? Because 500/4096 * 65536 = 8000

/Henrik.

You do not have permission to view the list of names.

#### Posting Permissions

• You may not post new threads
• You may not post replies
• You may not post attachments
• You may not edit your posts